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INTERMEDIATE DATA BASED VIDEO/AUDIO STREAMING 
METHOD 

CROSS-REFERENCES TO RELATED APPLICATIONS 
5 This application claims priority to Korean Application No. 99-1 8489 filed 

May 21, 1999 incorporated by reference herein. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

10 The present invention relates to a video/audio data transmission through a 

network and, more particularly, to an intermediate data based video/audio streaming 
method in which, in the transmission of video/audio data, a server transmits the 
video/audio data in the form of intermediate data and a client receives and directly 
processes it without using an additional decompression apparatus, allowing easy 

15 video/audio data transfer and simplifying the structure of the chent system. 

2. Discussion of Related Art 

In general, in the transmission of video (moving picture and still picture) 
data through a network, a transmitting side compresses the video data to be transmitted 

20 with various compression methods and then transmit it in view of a limited data transfer 
rate and the amount of data transmitted in the network . In this case, though the amount 
of data transmitted is remarkably reduced, a receiving side requires a separate apparatus 
for receiving the compressed video data and an apparatus for decompressing it, to receive 
and process the transmitted video data. 

25 FIG. 1 roughly illustrates the configuration of a conventional video/audio 

data processor, which shows a procedure that a computer opens a video file (JPEG, 
MPEG-1, MPEG-2, H.261, H.263, and so on) and executes it. Referring to FIG. 1, a data 
storage 1 stores the video file, and a decoder 2 which consists of a video decoder and 
audio decoder opens the video file stored in data storage 1, divides it into a video signal 

30 and an audio signal and decodes them using respective decoders. That is, the video 
decoder decodes the divided video signal while the audio decoder decodes the divided 
audio signal. Further, a video outputting unit 3 outputs the video signal decoded by 



decoder 2 and an audio outputting unit 4 externally outputs the audio signal decoded by 
decoder 2. 

FIG. 2 roughly illustrates the configuration of a conventional apparatus 
for video/audio data transmission and reception through a network, usually employed in 

5 a general VOD (Video On Demand). Referring to FIG. 2, the apparatus is classified into a 
server 10 and client 20. Server 10 stores a plurality of video files at a data storage 1 1 and, 
when chent 20 requests any video file, extracts the corresponding file to transmit it. 
Client 20 temporarily stores the video data supplied from server 10 at a buffer 21. A 
decoder 22 sequentially reads the data stored at buffer 21 and divides it into a video 

10 signal and an audio signal. Then, decoder 22 decodes the video signal using its inner 

video decoder and transmits it to a video outputting unit 23, thereby outputting the video 
data. Further, decoder 22 decodes the audio signal using its inner audio decoder and 
transfers it to an audio outputting unit 24, thereby accomplishing the output of audio 
data. 

15 In this conventional media file streaming method, the server transmits the 

compressed video file itself and the chent decompresses the compressed video file. That 
is, when the cHent requests a specific video file, the server reads and transmits the file 
itself Here, the server simply reads the corresponding compressed file and transfers it to 
the network without any change. Accordingly, the client needs an additional apparatus for 

20 decompressing the compressed file and decoding it to reconstruct the compressed file. 
This resuhs in complicated configuration of the client. Furthermore, the reception of the 
compressed file also requires a high-speed central processing unit. Accordingly, the 
hardware of the client system become difficult to realize and product cost increases. 

25 SUMMARY OF THE INVENTION 

Accordingly, the present invention directed to an intermediate data based 
video/audio streaming method that substantially obviates one or more of the problems 
due to limitations and disadvantages of the related art. 

An object of the present invention is to provide an intermediate data based 
30 video/audio streaming method in which in the transmission of video/audio data, a server 
transmits the video/audio data in the form of intermediate data and a client receives and 
directly processes it without using an additional decompression apparatus, allowing easy 
transferring of video/audio data and simpHfying the structure of the client system. 
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The intermediate data indicates pulse code modulation data (hereinafter, it 
is referred to as "PCM" data), adaptive differential pulse code modulation data (referred 
to as "ADPCM" data hereinafter), discrete cosine data (referred to as "DC" data) and Y, 
U, V (video signal components used in PAL or MAC system which corresponds to Y, 1, 
5 Q in NTSC system, referred to as "YUV" data hereinafter). 

In order to achieve the above object, in a method of streaming video/audio 
data through a network between a server and a cHent, the method comprising: 

a video/audio transmitting step of, in case that the server transmits a 
video/audio file to the client, converting compressed video/audio data to be transmitted 
1 0 into intermediate data and duphcating the intermediate data into a packet to transmit it to 
the chent; and 

in case that the client processes the intermediate data transmitted through 
the network, an intermediate data receiving step of 

a) analyzing the received packet, when the analyzed result corresponds to 
15 a video intermediate data packet, reconstructing the original video data from the video 

intermediate data duphcated into the packet and then outputting it, and 

b) when the received packet corresponds to an audio intermediate data 
packet, converting the audio intermediate data duphcated into the packet into analog 
voice data and outputting it. 

20 In the above, the video/audio transmitting step comprises: 

a first step of, in case that the server transmits the video/audio file to the 
chent, confirming by the server if the compressed file is an audio file, and confirming if 
the transmission form of the file corresponds to PCM transmission when the file is the 
audio file; 

25 a second step of converting the audio file to be transmitted into PCM data 

in case of the PCM transmission; 

a third step of converting the audio file to be transmitted into ADPCM data 
when it is confirmed that its transmission form does not correspond to PCM transmission; 

a fourth step of, when the compressed file corresponds to a video file, 
30 confirming if its transmission form corresponds to DC transmission; 

a fifth step of converting the compressed video file into DC data in case of 
the DC transmission; 

a sixth step of converting the compressed video file into YUV data when 
it is confirmed that its transmission form does not correspond to DC transmission; and 
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a seventh step of transmitting the converted audio/video intermediate data 

to the network. 

According to the aspect of the present invention, the seventh step 
comprises the steps of: 

in case that there is intermediate data to be transmitted to the network, 
confirming the type of the intermediate data, generating an ADPCM packet header when 
the intermediate data to be transmitted is ADPCM data, and duphcating a predetermined 
amount of ADPCM data into the packet generated; 

generating a PCM packet header when the intermediate data to be 
transmitted corresponds to PCM data; 

duphcating a predetermined amount of PCM data into the packet having 
the generated PCM header; 

generating a DC packet header when the intermediate data to be 
transmitted is DC data, and duphcating a predetermined amount of DC data into the 
packet having the generated DC header; 

generating a YUV packet header when the intermediate data to be 
transmitted is YUV data; 

duphcating a predetermined amount of YUV data into the packet having 
the generated YUV header; and 

transmitting the packet into which the intermediate data is dupHcated to 

the network. 

Furthermore, the procedure performed at the chent side comprises: 
a first step of analyzing the header of a packet received through the 

network; 

a second step of inverse-discrete-cosine-transforming the video 
intermediate data when the received packet is a DC packet; 

a third step of reconstructing sub-sampled data when the received packet 
is a YUV packet; 

a fourth step of converting the reconstructed data into RGB signals; 

a fifth step of scaling the RGB signals; 

a sixth step of displaying the scaled video signals on a picture; 
a seventh step of, when the received packet is an ADPCM packet, 
converting the received ADPCM intermediate data into PCM data; 



an eighth step of converting the PCM data converted or, when the 
received packet is a PCM packet, corresponding PCM data into an analog voice signal; 
and 

a ninth step of outputting the analog voice signal through a speaker. 

5 Additional features and advantages of the invention will be set forth in the 

description which follows, and in part will be apparent from the description, or may be 
learned by practice of the invention. The objectives and other advantages of the invention 
will be reaUzed and attained by the structure particularly pointed out in the written 
description and claims hereof as well as the appended drawings. 

10 It is to be understood that both the foregoing general description and the 

following detailed description are exemplary and explanatory and are intended to provide 
further explanation of the invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
1 5 The accompanying drawings, which are included to provide a further 

understanding of the invention and are incorporated in and constitute a part of this 
specification, illustrate embodiments of the invention and together with the description 
serve to explain the principles of the drawings: In the drawings: 

FIG. 1 roughly illustrates the configiiration of a conventional video/audio 

20 data processor; 

FIG. 2 roughly illustrates the configuration of a conventional apparatus 
for video/audio data transmission and reception through a network; 

FIG. 3 illustrates the configuration of a network system to which an 
intermediate data based video/audio streaming method proposed by the present invention 
25 is applied; 

FIG. 4 is a flow diagram showing an intermediate data transmitting 
procedure at a server side during the intermediate data based video/audio streaming 
according to the present invention; 

FIG. 5 is a flow diagram showing the intermediate data transmission 
30 procedure of FIG. 4 in more detail; 

FIG. 6 is a flow diagram showing a packet analysis procedure at a client 
side during the intermediate data based video/audio streaming according to the present 
invention; and 



5 



FIGs. 7A and 7B are protocol structures of an intermediate data packet 
proposed by the present invention. 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
5 Reference will now be made in detail to the preferred embodiments of the 

present invention, examples of which are illustrated in the accompanying drawings. 

FIG. 3 illustrates the configuration of a network system to which an 
intermediate data based video/audio streaming method proposed by the present invention 
is applied. This network system is roughly classified into a server 30 and a cUent 40. 
1 0 Server 30 stores compressed video/audio files at a data storage 3 1 therein, and an 

intermediate data generator 32 of server 30 converts the compressed video/audio files 
stored at data storage 31 into intermediate data to transmit it to the network. Here, the 
greatest difference between server 30 to which the present invention is applied and the 
conventional one (10 of FIG. 2) is that server 30 of the present invention converts the 
15 compressed video/audio files into intermediate data forms and transmits them to the 
network to provides them to the chent while conventional server 1 0 transfers the 
video/audio file requested by client 20 in the compressed form to client 20 through the 
network. 

At client side 40, a packet processor 41 receives a packet including the 
20 intermediate data transmitted through the network, processes it in real time, delivers the 
processed video signal to a video outputting unit 42 to output the video data, and sends 
the processed audio signal to a n audio outputting unit 43 to output the audio data. That 
is, packet processor 41 can process the received intermediate data in real time because 
the packet data is transmitted in the form of intermediate data through the network. In 
25 other words, the client simply processes the received video packet according to the form 
of intermediate data. Accordingly, the hardware structure of the client system can be 
simplified. 

FIG. 4 is a flow diagram showing a packet generation and transmission 
procedure at the server side during the intermediate data based video/audio streaming 
30 according to the present invention. Referring to FIG. 4, in case that the server transmits a 
video/audio file to the chent, the procedure at the server includes a step SI 1 of 
confirming if the compressed file is an audio file, a step S17 of confirming, when it is the 
audio file, if the transmission form of the file is PCM data, a step SI 8 of converting the 
compressed audio file into PCM data in case of PCM transmission, a step S19 of 
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converting the compressed audio file into ADPCM data when it is confirmed that the 
transmission form is not PCM data in step SI 7, a step S12 of confirming if the 
compressed file is a video file, a step S13 of, when the file to be transmitted is the video 
file, searching its transmission form, a step S14 of generating DC data when the video 
5 file is transmitted in the form of DC data, a step S 1 5 of generating YUV data when the 
searched transmission form is YUV data in step SI 3, and a step S16 of transmitting the 
intermediate data (ADPCM data, PCM data, DC data or YUV data) to a network. 

There is described below in more detail the procedure of transferring the 
video/audio file from the server to the client according to the present invention 

10 constructed as above. In step SI 1, the server first confirms if the file requested by the 
client is the audio file. When it is, the intermediate data generator of the server reads the 
corresponding audio file stored in the data storage. Then, the transmission form of the 
audio data is searched in step SI 7, and the read audio file is converted into PCM data as 
audio intermediate data in step SI 8 when the searched resuh corresponds to PCM data 

1 5 transmission. On the other hand, when the transmission form of the audio data 
corresponds to ADPCM data in step SI 7, the read audio file is converted into the 
ADPCM data as audio intermediate data in step SI 9. That is, the present invention sets 
the ADPCM data and PCM data as the audio intermediate data when the file to be 
transmitted is the audio file. 

20 Meanwhile, when the file requested by the client is the video file, the 

intermediate data generator of the server reads the corresponding video file stored in the 
data storage. Subsequently, the transmission form of the video data is searched in step 
SI 3, and, when the searched result corresponds to the DC data form, the read video file is 
converted into DC data as video intermediate data in step SI 4. In contrast, when the 

25 transmission form of the video data is the YUV data form in step SI 3, the read video file 
is converted into the YUV data as video intermediate data in step SI 5. The present 
invention sets the YUV data as another example of the video intermediate data. That is, 
the present invention sets the DC data that is inverse-quantized data and the YUV data 
that is inverse-discrete-cosine-transformed data as the intermediate data. The 

30 intermediate data items (DC data, YUV data, PCM data and ADPCM data) obtained 

through the aforementioned conversion process are separately transmitted to the client in 
step SI 6. 

FIG. 5 shows a procedure of transmitting the audio/video data that have 
been converted into the intermediate data. Referring to FIG. 5, when there is the 



intermediate data to be transferred to the network, it is first confirmed if the intermediate 
data is the ADPCM data in a step S21. When it is, an ADPCM packet header is generated 
in a step S25, and a predetermined amount of ADPCM is dupHcated into the packet 
having the generated ADPCM header in a step S26. When the intermediate data to be 
5 transmitted is not the ADPCM data in step S2 1 , it is confirmed if the intermediate data 
corresponds to the PCM data in a step S22. When it is, a PCM packet header is generated 
in a step S23, and then a predetermined amount of PCM data is duphcated into the packet 
having the PCM header in a step S24. 

When the intermediate data to be transferred is not the PCM data, it is 
10 confirmed if the data is the DC data in a step S27. When it is, a DC packet header is 
generated in a step S30 and a predetermined amount of DC data is duphcated into the 
packet having the DC header. On the other hand, when it is confirmed that the 
intermediate data is not the DC data in step S27, it corresponds to the YUV data, 
generating a YUV packet header in a step S28. Subsequently, in a step S29, a 
1 5 predetermined amount of YUV data is duplicated into the packet having the YUV header, 
to be suitable for sub-samphng. The packet into which the ADPCM data or PCM data, or 
DC data or YUV data is duplicated is transmitted to the network in a step S32. It is 
confirmed if there is more intermediate data to be transmitted in a step S3 3 and, when 
there is, the procedure returns to step S21, repeating the processes. 
20 FIG. 6 is a flow diagram showing an intermediate data receiving procedure 

at the cUent side during the intermediate data based video/audio streaming according to 
the present invention. Referring to FIG. 6, the procedure includes a first step S41 and 

542 of analyzing the header of the packet received through the network, a second step 

543 and S44 of inverse-discrete -cosine-transforming the video intermediate data when 
25 the received packet is the DC packet, a third step S45 and S46 of reconstructing sub- 
sampled data when the received packet is the YUV packet or DC data that has undergone 
inverse discrete cosine transform, a fourth step S47 of converting the reconstructed data 
into RGB signals, a fifth step S48 of scaling the RGB signals, a sixth step S49 of 
displaying the scaled video signals on a picture, a seventh step S50 and S51 of, when the 

30 received packet is the ADPCM packet, converting the received ADPCM intermediate 
data into PCM data, an eighth step S52 of converting the PCM data converted or, when 
the received packet corresponds to the PCM packet, corresponding PCM data into an 
analog voice signal, and a ninth step S53 of outputting the analog voice signal through a 
speaker. 



There is described below in detail the aforementioned procedure of 
analyzing and outputting the received packet at the client according to the present 
invention. First of all, in step S41, the client receives the packet transmitted from the 
server through the network. The header of the received packet is analyzed in step S42. 
5 When the received video packet corresponds to the DC data as intermediate data that has 
been inverse-quantized, inverse discrete cosine transform (IDCT) is performed to 
transform the received DC packet into YUV data in step S44. Then, the sub -sampled 
data is converted into the original video data, and the converted video data is transformed 
into RGB signals in steps S46 and S47. Subsequently, scaling process is carried out in 
10 step S48, and the scaled RGB signals are displayed on the picture in step S49. 

Meanwhile, when the received packet corresponds to the YUV packet, the 
sub-sampled data is reconstructed into the original video data in step S46. Thereafter, the 
reconstructed video data is converted into RGB signals, to be scaled in steps S47 and S48. 
The scaled RGB signals are displayed on the picture in step S49. When the received 
15 packet corresponds to the ADPCM packet, it is converted into PCM data in step S51 and 
then converted into the analog voice signal in step S52, being outputted through a speaker 
in step S53. Here, a special transmission regulation is required to effectively transfer the 
intermediate data through the network and to reduce the load on the client. This 
regulation is for the purpose of minimizing damages caused by a loss of the packet which 
20 may occur during the network transmission procedure. A protocol for the intermediate 
data transmission is shown in FIGs. 7 A and 7B. 

FIG. 7A illustrates the structure of a packet transmitted. In this structure, 
the packet header with a predetermined size is located at the front part thereof and packet 
data (DC data, YUV data, PCM data and ADPCM data) in a predetermined size is loaded 
25 at the following part. FIG. 7B shows the packet header of FIG. 7A in more detail. As 

shown in FIG. 7B, the length of the header is 20 bytes, 8 bits are assigned for indicating if 
the packet data is YUV data (0*A0), voice data (0*A1), DC data (0*A2) or ADPCM data 
(0*A3), and 3 bytes are assigned to the packet number. In addition, 12 bytes are allotted 
to a field for controlling data designated by command ID, and 4 bytes are assigned to a 
30 field for reservation. 

As described above, the present invention transmits video/audio data in the 
form of intermediate data in case that video/audio files are transferred through a network, 
to allow the client to be able to simply receive the packet from the network and process it 
in real time. Accordingly, the client does not need a buffer for storing the compressed 



files, a decoder for decoding them and a high-speed central processing unit, resulting in 
simplification of the entire hardware configuration. Furthermore, it is possible to 
construct the client only with a network card, video card, audio card, controller, and the 
minimum number of memory because it simply receives and processes the intermediate 
5 data. This simplifies the hardware configiu-ation of the client, reducing the client 

construction cost. Moreover, since the client processes only data entering the network 
and the server has most of data controlling functions, the server can easily control the 
chent. In addition, if the object that the cUent requests is a file which can be converted 
into intermediate data form, the service is available without upgrading the chent. That is, 
1 0 even when a new compression format is developed, the client can receive and process 

data in real time if software for decoding suitable for the server is installed. Accordingly, 
it is very flexible and economical in system maintenance and its performance 
improvement. 

It will be apparent to those skilled in the art that various modifications and 
15 variations can be made in the intermediate data based video/audio streaming of the 

present invention without departing fi-om the spirit or scope of the invention. Thus, it is 
intended that the present invention covers the modifications and variations of this 
invention provided they come within the scope of the appended claims and their 
equivalents. 
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WHAT IS CLAIMED IS: 

1 1 . A method of streaming video/audio data through a network 

2 between a server and a client, the method comprising: 

3 a video/audio transmitting step of, in case that the server transmits a 

4 video/audio file to the client, converting compressed video/audio data to be ransmitted 

5 into intermediate data and duplicating the intermediate data into a packet to transmit it to 

6 the client; and 

7 in case that the cUent processes the intermediate data transmitted through 

8 the network, an intermediate data receiving step of 

9 a) analyzing the received packet, when the analyzed result corresponds to a 

10 video intermediate data packet, reconstructing the original video data from the video 

1 1 intermediate data duphcated into the packet and then outputting it, and 

12 b) when the received packet corresponds to an audio intermediate data 

13 packet, converting the audio intermediate data duplicated into the packet into analog 

14 voice data and outputting it. 

1 2. The method as claimed in claim 1, wherein the video/audio 

2 transmitting step comprises: 

3 a first step of, in case that the server transmits the video/audio file to the 

4 client, confirming by the server if the compressed file is an audio file, and confirming if 

5 the transmission form of the file corresponds to PCM transmission when the file is the 

6 audio file; 

7 a second step of converting the audio file to be transmitted into PCM data 

8 in case of the PCM transmission; 

9 a third step of converting the audio file to be transmitted into ADPCM data 

1 0 when it is confirmed that its transmission form does not correspond to PCM transmission; 

11 a fourth step of, when the compressed file corresponds to a video file, 

1 2 confirming if its transmission form corresponds to DC transmission; 

1 3 a fifth step of converting the compressed video file into DC data in case of 

14 the DC transmission; 

15 a sixth step of converting the compressed video file into YUV data when it 

16 is confirmed that its transmission form does not correspond to DC transmission; and 

17 a seventh step of transmitting the converted audio/video intermediate data 

18 to the network. 
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1 3. The method as claimed in claim 2, wherein the seventh step 

2 comprises the steps of: 

3 in case that there is intermediate data to be transmitted to the network, 

4 confirming the type of the intermediate data, generating an ADPCM packet header when 

5 the intermediate data to be transmitted is ADPCM data, and duplicating a predetermined 

6 amount of ADPCM data into the packet generated; 

7 generating a PCM packet header when the intermediate data to be 

8 transmitted corresponds to PCM data; 

9 duplicating a predetermined amount of PCM data into the packet having 

10 the generated PCM header; 

1 1 generating a DC packet header when the intermediate data to be 

12 transmitted is DC data, and duphcating a predetermined amount of DC data into the 

1 3 packet having the generated DC header; 

1 4 generating a YUV packet header when the intermediate data to be 

1 5 transmitted is YUV data; 

1 6 duplicating a predetermined amount of YUV data into the packet having 

17 the generated YUV header; and 

1 8 transmitting the packet into which the intermediate data is duphcated to 

19 the network. 



1 4. The method as claimed in claim 1 or 2, wherein the intermediate 

2 data corresponds to, in case of video data, DC data obtained by variable-length- 

3 demodulating compressed video data and transforming the variable-length-demodulated 

4 video data into a frequency range to inverse-quantize it; YUV data obtained by inverse- 

5 discrete-cosine-transforming the DC data to convert it into a YUV value; and, in case of 

6 audio data, PCM data and ADPCM data. 



1 5. The method as claimed in claim 1, wherein the procedure 

2 performed at the client side comprises: 

3 a first step of analyzing the header of a packet received through the 

4 network; 

5 a second step of inverse-discrete-cosine-transforming the video 

6 intermediate data when the received packet is a DC packet; 
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7 a third step of reconstructing sub-sampled data when the received packet is 

8 a YUV packet; 

9 a fourth step of converting the reconstructed data into RGB signals; 

10 a fifth step of scaling the RGB signals; 

1 1 a sixth step of displaying the scaled video signals on a picture; 

12 a seventh step of, when the received packet is an ADPCM packet, 

1 3 converting the received ADPCM intermediate data into PCM data; 

14 an eighth step of converting the PCM data converted or, when the received 

1 5 packet is a PCM packet, corresponding PCM data into an analog voice signal; and 

16 a ninth step of outputting the analog voice signal through a speaker. 
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INTERMEDIATE DATA BASED VIDEO/AUDIO STREAMING METHOD 

ABSTRACT OF THE DISCLOSURE 
There is provided an intermediate data based video/audio streaming method in 
which, in the transmission of video/audio data, a server transmits the video/audio data in the 
5 form of intermediate data and a cHent receives and directly processes it without using an 
additional decompression apparatus, allowing easy video/audio data transfer and simplifying 
the structure of the client system. The method includes: a video/audio transmitting step of, in 
case that the server transmits a video/audio file to the client, converting compressed 
video/audio data to be transmitted into intermediate data and duplicating the intermediate 

10 data into a packet to transmit it to the chent; and, in case that the client processes the 

intermediate data transmitted through the network, an intermediate data receiving step of 
analyzing the received packet, when the analyzed result corresponds to a video intermediate 
data packet, reconstructing the original video data from the video intermediate data 
duplicated into the packet and then outputting it, and, when the received packet corresponds 

15 to an audio intermediate data packet, converting the audio intermediate data duplicated into 
the packet into analog voice data and outputting it. 

PA 3071330 vl 
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